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MULTIMEDIA COMMUNICATION DEVICE TO CAPTURE AND INSERT A MULTIMEDIA SAMPLE 



The invention relates to a device for multimedia communication, comprising 
capture means for capturing a sample of multimedia content and processing means for 
processing a message. 

The invention also relates to a method for multimedia communication, the 
5 method comprising the steps of capturing a sample of multimedia content and processing a 
message. 



A device as described in the opening paragraph is known from the 

10 Sony Ericson P800 mobile phone as described in its User's Guide, First Edition (November 
2002), issued by Sony Ericsson Mobile Communications AB, publication number 
EN/LZT 108 6040 Rl A. Many mobile phones nowadays come with the ability to take 
pictures, in addition to the ability of sending Multimedia Message Service (MMS) messages. 
So-called emoticons like the smiley © can be inserted in the text of a message to express the 

15 authors' mood. Inserting emoticons is relatively simple. Using a camera, a sample or 

snapshot like a photograph or still image may be included in a message for the same purpose 
of expressing the author's mood. With a sample included, it can also become much easier for 
a receiver of the message to identify and authenticate its author. Moreover, a sample also 
easily conveys the current situation of the author, thus providing a framework for interpreting 

20 the message. Sending a message with an included sample, however, involves the steps of 
taking the sample, storing the sample, including the sample in the message by editing the 
message and selecting the stored sample. Finally, the message can be dispatched. Most of 
these steps require the user to repeatedly operate the device manually. This increases the 
possibilities of making accidental or intended errors, which deteriorates the value of the 

25 sample for authentication purposes. It also causes the sending of such messages with the 
device to be laborious and complicated for the user. 
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It is an object of the present invention to provide a device for multimedia 
communication of the kind described in the opening paragraph that does not suffer from the 
above-mentioned drawbacks. 

This object is realized in that the device comprises control means for 
5 controlling the capture means and the processing means, such that the sample is captured and 
added to the message in response to a single activation of the control means. Due to the 
single activation, capturing and adding become an indivisible action, making it more difficult 
to tamper with the sample. The single activation also saves the separate steps of operating the 
device for capturing, storing, retrieving and inserting the sample. 
10 Advantageously, the device further comprises dispatching means for 

dispatching the message with the sample added in response to the single activation. This 
saves another additional manual step in operating the device and further limits the 
possibilities of tampering with the dispatched message. 

Advantageously, the capture means comprise a camera, and the sample 
15 comprises a photo. In order to capture the mood of the author, a photo taken with a camera 
has the additional benefit of easily exploiting facial expressions. Another advantage is that 
the photo can also easily convey the actual context of the author for interpreting the message. 

Advantageously, the device comprises a mobile phone. This has the advantage 
of an easy switch to a more interactive voice call in response to receiving a message. 
20 Alternatively, a message with a sample can easily be sent to the other party during a voice 
call or during some other communication session. 

Advantageously, the message comprises a command for controlling a 
communication session. This has the advantage that the sample can provide additional 
information pertaining to the sender of the message or to the session. Also there is no risk of 
25 out-of-date or unfashionable samples. It may be useful, for example, to show a picture of a 
participant leaving the session, especially if there are many participants in the session. The 
sample may also be used during the session, for example, as a reminder of the participants in 
the session, or to identify a participant to the other participants. 

Advantageously, the message comprises an invitation for a communication 
30 session. This has the advantage that it prevents the hassle of creating, storing and maintaining 
entries in an address book at the destination for a so-called multimedia caller identification 
service. With this service, the sample is reproduced at the destination upon reception, 
simplifying the recognition of the inviting party. One example is showing a thumbnail picture 
of the caller with an incoming call. Another example is an audio sample with the name of the 



WO 2004/095815 



PCT7IB2004/050499 



3 

caller, or a short clip introducing the topic of the session. A device according to the invention 
makes picture caller identification possible without any prior contact between the sender and 
the receiver. Moreover, the sample can give additional and actual information on the 
intention of the session or its context, making it easier for the recipient to decide on 
5 participation. Furthermore, the sample may persuade the recipient to participate in the 
session. 

In an embodiment of the method for multimedia communication according to 
the invention, the method comprises the steps of: 

- capturing a sample of a multimedia content, 
10 - processing a message, and 

- activating a single control for capturing the sample and adding the sample to the 
message. This method reduces the possibilities of tampering with the sample, and 
saves a few steps in operating the device for capturing, storing, retrieving and 
inserting the sample. 

15 Advantageously, activating the single control also dispatches the message, 

further reducing the possibilities of tampering with the message, and saving another 
additional manual step in operating the device. 



20 The above object and features of the present invention will be more apparent 

from the following description of the preferred embodiments with reference to the drawing 
wherein Fig. 1 is a block diagram of an embodiment of a device according to the invention. 

Some of the features indicated in the drawing may be implemented in 
software, and as such represent software entities, such as software modules or objects. 

25 



Fig. 1 is a block diagram of an embodiment of a device 100 according to the 

invention. 

The device 100 for multimedia communication comprises control means 110, 
30 capture means 121 and processing means 122. Optionally, the device 100 comprises 

dispatching means 123. The device 100 may be distributed, comprising separate physical 
parts that are connected to perform its functions as a whole. An example of this is a device 
100 that comprises a mobile phone and a so-called snap-on camera that can be snapped onto 
the phone. Another example is a so-called personal digital assistant (PDA) or a desktop or 
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palmtop personal computer (PC) that communicates wirelessly with a separate multimedia 
recorder, for example, based on the so-called BlueTooth standard. Thus, the device 100 
covers a single logical entity rather than a single physical entity. The device 100 may also be 
a multimedia terminal, which may be mobile, portable, handheld or fixed and wireless or 

5 wired. Also, the device 100 may comprise a general-purpose hardware platform provided 
with means or instructions, which provide the functionality of a multimedia terminal. 

Using control signals 131, the control means 110 control the capture means 
121, the processing means 122, and the dispatching means 123. In response to a single 
activation 130 of the control means 1 10, the control means 110 ensure that a sample is 

10 captured and added to a message 134 and that, optionally, the message 134 is dispatched 135. 

The message 134 may be, for example, a short message service (SMS) 
message, or a multimedia message (MMS) or an electronic mail message, or a message in 
general as used with instant messaging or chatting or as used with unified messaging or 
multimedia communication. 

15 The capture means 121 can capture a sample 133 of a multimedia content 136. 

Capturing the multimedia content 136 may comprise capturing several components. One 
component may be a still image or snapshot. Another example of a component is a series of 
images or a series of images with such a frequency that a short movie or clip is captured. 
Another component is audio, for example, an audio sample of a few seconds or a 

20 stereophonic audio sample. Another example is a voice message or voicemail. Also capturing 
a color can result in a component, or capturing a bar code. Other components include 
temperature and smell. Yet another component may be tactile information as derived from a 
hand grip or sensed with a glove. All of the above examples are easily extended to include 
further components and are, therefore, not intended to limit the components in either way. 

25 Also combinations of components can be made. One example is a combination of video and 
audio components to obtain an audiovisual sample as is normally reproduced in a television 
set. Capturing is initiated by the control signals 131 from the control means 1 10, in response 
to the single activation 130. After capturing, the sample 133 is forwarded to the processing 
means 122. To alert to the user that capturing is in progress, the device 100 may comprise 

30 visual or audible indicating means (not shown). Examples include a light-emitting diode 
(LED) that emits light as long as capturing is in progress, and a speaker that mimics the 
"fladack" sound of a mirror-reflex camera. Another example is an indicator like a bar, 
indicating the progress while capturing a sample or clip with a fixed duration. 
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The processing means 122 serve the purposes of creating, composing and/or 
editing a message 134. The processing means 122 may provide the end-user (not shown) with 
the tools (not shown) for inserting text or other objects into a message 134. This typically 
comprises hardware and software providing an editing environment, like those known from 

5 text processors. The content of the message 1 34 is modified at a spot usually indicated by a 
cursor (not shown). In response to the control signals 131 from the control means 1 10, the 
processing means 122 insert the sample 133 with all its captured components as received 
from the capturing means 121, at the cursor without further user intervention. When done 
processing, the message 134 is optionally forwarded to the dispatching means 123. 

10 If a message 134 was not already being processed upon the single activation 

130, the control means 1 10 may also cause the message 134 to be created by the process 
means 122. 

The dispatching means 123 allow dispatching of the processed message 134. 
This causes a message 135 to be dispatched from the device 100, on either a wired or 

15 wireless medium (not shown) towards a recipient (not shown) of the message or to an 

intermediate station (not shown). The message 134 received from the processing means is 
dispatched in response to the control signals i31 from the control means. 

What happens in effect is that, upon activating the control means 1 10, a 
sample 133 is captured 132, the sample 133 is added to the message 134, and the message 

20 134 is optionally dispatched 135. 

The control means 110 may comprise a physical button (not shown) on the 
device 100. Alternatively, a so -called soft button can be rendered on a display screen (not 
shown). The soft button is activated by clicking it with a mouse or tapping a touch-sensitive 
screen with a stylus or with a finger in its proximity. The control means 1 10 may be arranged 

25 to dispatch the message upon activation to a recipient that is represented on the display 
screen. Especially, the control means 110 may be arranged to dispatch the message upon 
activation to one or more selected recipients that are part of a list shown on the display 
screen. Selecting the recipients can be based on the way the recipients are listed, like 
highlighted or colored differently. Selecting the recipients can also be based on the distance 

30 between the displayed recipient and the spot of clicking, such that the closest recipient is 
selected. Recipients can also be selected from the parties currently engaged in 
communication sessions of the device 100, like voice calls or chat sessions. 

Received samples can be stored and subsequently used at the receiving device. 
One example of using such a stored sample is that it serves as a reminder for the participants 
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of the session. Another example is identification of one particular participant to all 
participants, or, for example, identifying the chair of the session to enhance so-called floor 
control mechanisms. 

The message 134 may comprise a command (not shown) for controlling a 
5 communication session (not shown). The recipient of the dispatched message 135 is 

requested to apply the command to the communication session. In response to receiving the 
message, the sample 133 can then be reproduced at the receiving device (not shown) as part 
of handling the received message 135. An example of a command is to accept or reject an 
invitation to the session, terminate the session, or remove the sender as a participant of the 

10 session or change some other parameters of the session, like streaming details as ports, 
addresses, packet routing, encoding, decoding, buffering, protocols, flow control, etc. The 
sample 133 can identify, for example, a person entering or leaving the session, or a fresh 
hello or farewell greeting from that person. 

The message 134 may also comprise an invitation (not shown) for a 

15 communication session (not shown). The recipient of the dispatched message 135 is invited 
to engage in the communication session. In response to receiving the message, the sample 
133 can then be reproduced at the receiving device (not shown) as part of handling the 
received message 135. The reproduced sample can make it easier for the recipient to decide 
about accepting or rejecting the invitation, and, as a result, to decide upon participation in the 

20 communication session. The sample may also describe the sender or the session. Examples 
include the topic of the session, its setting or context, the current situation of the sender in 
relation to the session, etc. Presenting the sample may be more descriptive to the recipient 
than presenting, for example, a telephone number, a nickname or a user identifier. Also, the 
sample may persuade the recipient to participate. If the recipient accepts the invitation, the 

25 recipient is added to the participants of the session. If required, the session can be created in 
response to accepting the invitation by either the receiving or the sending device. 

Alternatives are possible. In the description above, use of the verb "comprise" 
and its conjugations does not exclude other elements or steps, and use of the indefinite article 
"a" or "an" does not exclude a plurality of such elements or steps, while a single processor or 

30 other unit may also fulfill the functions of several means recited in the claims. 



